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ABSTRACT 

This bulletin reports some of the findings from an 
analysis of assessments in mathematics that have been conducted in 32 
states. Note is made of the variability in state reports, which make 
data comparisons implausible. Trends, however, could be observed. 
Each state department was contacted for a copy of the most recent 
mathematics assessment results; reports from years ranging from 1955 
to 1984 were received from 32 states. The overall trend of increased 
achievement is first noted. Then achievement patterns are presented, 
with graphs for addition, subtraction, multiplication, and division 
with whole numbers; fractions; decimals; numeration; measurement; 
geometry; and problem solving. (MNS) 
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Achievement in Mathematics Education 



Concern about achievement in mathe- 
matics is not a recent phenomenon. It is a 
continuing concern for a subject area th at 
is considered to be at the core of educa- 
tion, but it seems to reach new heights 
every few decades. The accountability 
movement that began in the 1970s put 
new emphasis on testing children, and 
steto after state mandated ci legislated 
that some type of regular assessment 
must be made of the products of schools. 

This bulletin reports some of the find- 
ings from an analysis of the assessments 
of mathematics that have been conducted 
in 32 states. Additional information, plus 
tables or the scores from each state on a 
recent assessment, may be found in an 
LRIC/SMEAC publication, Assessing 
Achievement Across the States: Mathe- 
matical Strengths and Weaknesses. In 
that document, the amount of variability in 
the state reports is stressed <or instance: 

• Some states u^e standardized tests; 
other states haze developed their 
own. 

• Scnne states have tested only (bare) 
minimum skills; other states have 
broadened the scope to attempt to 
ascertain how extensively students 
have learned a wide range of topics. 



^v^nffe tests have focused on knowl- 
edefe; others have attempted to mea- 
sure higher levels of learning, 

• Some states have invo'ved panels of 
teachers and other mathematics 
educators in developing the tests, 
and have even collected data on the 
validity and reliability of the tests, 
while others have used state depart- 
ment personnel. 

• Some states have carefully built in 
comparisons with data from the Na- 
tional Assessment of Educational 
Progress(including, frequently, using 
NAEP items for at least a part of their 
testing), others have run compari- 
sons with norms from one or more 
standardized tests, while still others 
have made no comparisons. 
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• Some have kept track of how the 
achievement in their state changes 
from year to year, while others give 
little indication of prior tests. 

• Some have given assessments every 
. _ .f, on a (somewhat) established 
time table, while others have given 
them once or twice— or at an interval 
of ten years. 

• Some few assess every grade level; 
most assess what they have identi- 
fied as focal points— but the focal 
points differ from state to state. 

In addition to these variations in how th e 
assessment task was approached, there 
are decided differences in the way the 
data are reported. Because of this vari- 
ability, it is hazardous to make compari- 
sons: the data are not comparable. It 
seems possible, however, to determin*- 
what trends in mathematics achievement 
are evidenced. 

How the Information Was Collected 

A search of the ERIC database revealed 
that reports of state assessments in 
mathematics either were difficult to locate, 
largely because most assessments in- 
clude more than mathematics, or were 
questionable in terms of recency. There- 
fore, a letter was sent tc each of the state 
mathematics supervisors, or, in the cases 
where such a petsco is not identified, to 
iho state department as an entity. The 
letter stated tho problem and asked that a 
copy of "the most recent mathematics 
assessment r esults" be sent. In all, 38 
°. : ates responded, three \Mh letters that 
they had no state arsessment, throe with 
test documents but no data, and the re- 
mainder (32) with documents containing 
data. 

On Table 1, the information received 
from each state is summarized. In the 
column for "type of test", N stands for 
normed or standardized test and S stands 
for state-developed test The date indi- 
cates the year when a test was given for 
which data were sent (it does not indicate 
all of the times when a test was given in a 
state). 



Tables of the scores were next de- 
veloped, by item whenever possible. Then 
scores on topical areas (for instance, 
add.tion with whole numbers) were com- 
piled. Finally, items on which students 
scored low were listed, as an indication of 
those objectives with which students were 
having difficulty However, this list is not 
included in this bulletin. 



TABLE 1 
SUMMARY OF DATA RECEIVED 





Type 

of Test 




Levels 


State 


D*to GW*n 


Tested 


Alabama 


N 


1984 


2. 4. 5. 8.10 




S 

s 


19C4 

1983, 1984 


3.6.9 
12 


Arkansas 


s 


1982-83 


3. 6.8 


California 


s 


1979-1983 


3,6.12 


Connecticut 


s 


1980-1983 


9 


Delaware 


N 


1981-1983 


1-8, 11 




N 


1984 


1-8.11 


Florida 


S 


1982 


3.5. 8.10 


Hawaii 


N 


1981-1983 


2.4,6 


Idaho 


S 


1984 


8.9 


Illinois 


S 


1976-1983 


4.8,11 


Indiana 


N 


1980-1982 


all 


lowa 


S 


1975-76 


5.8 




N 


1965*1977 


3-8.9-12 


Kansas 


S 


1982-83 


2.4. 6. 8.11 


Louisiana 


S 


1982-1984 


7.10 


Michigan 


r» 


1980-81 


4. 7. 10 


Minnesota 


S 


1982-83 


4. 8.11 


Mississippi 


N 


1977-1983 


4. 6.8 


Montana 


S 


198- 


6.11 


Nevada 


y 


1979-1983 


9 




N 


1979-1983 


3.6 


New Hampshire 


S 


1980 


5,9, 12 


New Jersey 


S 


1977-1983 


9, 10 


New Mexico 


N 


1984 


3,5.8 


North Carolina 


N 


1983 


1.2 




N 


1983 


3.6,9 


North Dakota 


S 


1975-1979 


4. 6, 8. 1 1 


Ohio 
Oregon 


S 


1977. 1978 


4. 8. 12 


S 


1982 


4. 7, 1 1 


Pennsylvania 


S 


1983 


5. 8,11 


T*xas 


S 


1980-1933 


3, 5,9. 10. 
11. 12 


Virginia 


N 


1981-1984 


4. 8. 1 1 


Washington 


N 


1979-1983 


4. 8. 1 1 


West Virginia 


N 


1976-1980 


3.6.9. 11 


Wisconsin 


S 


1976-1982 


4. 8. 12 


Wyoming 


S 


1977 


12 



Caution must be taken in evaluating the 
results. Not only did most objectives differ 
in their level of inclusion or exclusion, the 
items written to test even the same objec- 
tive differed. Seemingly small differences 
in the wording of an item, or in a diagram, 
can result in markedly different scores. 
Differences in difficulty level of items also 
occurred as grade level increased. This 
report therefore attempts to look at broad 



topics, rather than at specfic objectives, in 
order to improve instruction, it is impera- 
tive that scores on specific objectives be 
analyzed The intent here Is merely to step 
back and detern.ne the broader trends 
and patterns that occur. 

Trends in Achievement 

The general trend in mathematics 
achievement is upward, at least since the 
beginni ngof the 1 980s, as indicated by the 
state assessment results. Table 2 depicts 
the patterns indicated by data from 17 
states for which data from two or more 
assessment years were received In 33 
instances, scores rose between assess- 
ments In 11 instances, scores declined, 
while in 19 instances, they remained ap- 
proximately the same. Caution must be 
t ken. however, since dates as well as 



type of test are varied. This is illustrated, 
for instance, in the case of Iowa. The table 
indicates that scores in Iowa declined 
between assessments. However, the data 
received from Iowa were for tests given 
between 1955 and 1977. A recent docu- 
ment from Iowa in which trends were 
analyzed for the period from 1955 through 
1984 indicates that: 

The achievement trend reached its 
minimum in the 1974-75 school year. 
Since that time, achievement has in- 
creased slowly but consistently. During 
the past year, achievement was at or 
near an ail-time high in Grades 3-6 in 
most test areas. In Grades 7-8, 
achievement is still below the 1965 
level but has been steadily improving. 
(Hoover, 1985, p. 1) 
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TABLE 2 
TRENDS IN ACHIEVEMENT 

Grade 



State 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


Arkansas 


t 






t 




t 










California 






















Connecticut 














t 








Delaware 




t 


t 


t 


t 


t 










Hawaii 






















Illinois 




t 








t 






t 




Indiana 






















Iowa 






















Louisiana 










t 






t 






Minnesota 












t 






t 




Mississippi 




t 




t 




t 










Nevada 


















t 




New Jersey 














t 








Texas 






t 








t 


t 






Virginia 




t 








t 






t 




West Virginia 


t 






t 






t 




t 




Wisconsin 
























Achievement Patterns by Topic 



To illustrate how well students are scor- 
ing on particular topics, the data from the 
latest state-developed test received were 
collated. Only those pointsat which there 



Addition with Whole Numbers 

For addition with whole numbers, duL- 
for grades 3, 4, 5, 8, and 9 are displayed in 
Figure 1. Note that almost no scores are 
below the 80 percent level, and that in all 
instances they approach the 100 percent 
level. The range in each case is narrow, 
and most of the scores on individual items 
are in the 90s (indicated by the heavier 
band). 

By grade 3, most students are at a high 
level of proficiency on addition computa- 
tion, and they retain that proficiency 
through the grades. This same pattern is 
true at other grade levels not included in 
Figure 1. 



Subtraction with 
Whole Numbers 

The picture for subtraction with whole 
numbers is one of greater variability, 
especially in grades 3. 4, and 5 (see Figure 
2). By grades 8 and 9. however, most 
students have reached about the same 
level of proficiency with subtraction as 
they have attained with addition. More- 
over, the same pattern prevails at other 
grade levels. 



were sufficient data being reported (by a 
number of states, on a number of items) 
were included. Topics meeting this cri- 
terion, at varying grade levels, are. addi- 



tion, subtraction, multiplication, and 
division with whole numbers, fractions, 
decimals, numeration, geometry, mea- 
surement; and problem solving. 



Grade 3 



•o 



90 



Grade 4 [_ 



r 



10 t7 



Grade 5 



15 95 



Grade 8 



59 
i 



12 t? 



Grade 9 



•o 



100 



Figure 1. Addition with Whole Numbers 



Grade 3 |_ 



59 



Grade 4 



57 



»5 



Grade 5 |_ 



•5 



H h 



91 



H 1 



Grade 8 



5« 



79 99 97 



Grade 9 



•4 100 



Figure 2. Subtraction with Whole Numbers 
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Multiplication with 
Whole Numbers 

For multiplication with whole numbers, 
the range of scores is also rather broad in 
grades 4, 5, and 6, but the upper limits are 
higher than for subtraction at the lower 
grade levels (see Figure 3). By grade 9, the 
scores of most of the students indicate 
mastery, and this is verified by the limited 
data for grades 10-12. 



Grade 4 |_ 



45 

I 



70 



Grade 5 



Grade 8 



4$ 54 

-H— L - 



•3 



69 



17 



Grade 9 



75 



91 100 



Figure 3. Multiplication with Whole Numbers 



Division with Whole Numbers 

Not unexpectedly, the ranges of scores 
for division with whole numbers are broad 
and tend to remain so across grade levels, 
although in grades 4, 8, and 9 the upper 
limit is high and in grade 5 it would appear 
acceptable (see Figure 4). The band indi- 
cating where the most scores at each 
grade level lie is lower, however— in the 
70s at the lower levels and in the 80s at 
grade 9. (For addition, the band was in the 
90s at all grade levels; for subtraction and 
multiplication, it rose to the 90s by grade 
9.) Division is of continuing difficulty for 
many students. However, division is the 
last of the f ou r operations to be introduced 
to students, and they have had less time to 
practice and master the algorithm. This 
time factor combines with the difficulty of 
the algorithm to depress achievement. 
Scores do tend to improve in grades 10- 
12, although they do not reach the high 
levels attained with the other operations. 



Grade 4 



Grade 5 



Grade 8 



Grade 9 



34 



51 



tl 



*I5 



71 



16 



Figure 4. Division with Whole Numbers 
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Fractions 

A certain consistency seems to char- 
acterize the scores for achievement on 
fractions (sje Figure 5). Depicted are 
scores of concepts of, for instance, 
equivalence, as well as scores for com- 
putation. In each instance, one or more 
scores is markedly deviant from the 
others; <n some cases these may indicate 
that the item was either very difficult or 
was faulty. The lower limit 01 scores at 
most grade levels isaround the 50 percent 
level; while the upper limit is near or in the 
90s, the band indicating where most 
scores lie is between 75% and 85% only in 
grade 11. Achievement with fractions for 
most students is clearly below their level 
of achievement with whole numbers. 



Grade 4 



Grade 5 



Grade 6 



Grade 8 



15 

I 



41 



17 1 22 
_LL 



41 



36 42 4t 

I t 



•5 



25 35 42 41 

— 1 1 1 U. 



91 



Grade 9 



24 

_1_ 



52 



-H 



Grade 1 1 



2« 



53 



91 



Grade 12 |_ 



31 50 



94 



Figures. Fractions 



Decimals 

For decimals, a somewhat variable pic- 
ture is again presented (see Figure 6). 
Except for the unexplainable case of 
grade 1 1 » the band where most scores lie 
is in the 80s, indicating an acceptable 
level of achievement. However, for many 
students, on many objectives for work with 
decimals, difficulties persist through the 
grades. 



Grade 6 



Grade 8 



Grade 9 



46 56 



91 



42 

H h 



34 41 

I L_ 



54 



95 



97 



-H- 



Grade 11 |_ 



22 



33 



93 

H ! 



Grade 12 |_ 



45 

-M- 



96 



Figure 6. Decimals 
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Numeration 

On numeration, attainment on most 
items is acceptable, as shown by the 
bands in the 90s in grades 3, 4, and 5 and 
in the 80s in grade 8 (see Figure 7). Why 
this drops is uncertain, but it may be that 
concepts taught earlier have not been 
retained, or it may be that the objectives 
being tested have expanded to include 
many topics beyond the place valuo 3m« 
phasis in the early years. The limited data 
for grades 11 and 12 show continued 
variability, although the band where most 
students score is in the 90s by grade 12. 



Grade 3 



Grade 4 



Grade 5 



Grade 8 



61 



64 



43 50 57 86 
-J 1 1 L— 



23 33 41 47 
-J 1 1 U 



Figure 7. Numeration 



Measurement 

Variability also characterizes the mea- 
surement scores (see Figure 9), It is ap- 
parent from the data that items assessing 
skills or understanding with the common 
English measurement system are easier 
for students than are items dealing with 
metric measurement. The bands depict 
three instances where the same number 
of items were being ansv/ered correctly at 
two points— at grade 5 in the 30s and 90s, 
at grade 9 in the 60s and 90s, and at grade 
1 2 in the 70s and 80s. An extended look at 
the curriculum, at what is actually being 
taught, and at the test items seems 
needed. 



Grade 4 



Grade 5 



Grade 8 



Grade 9 



15 



32 



27 
I 



40 

L_ 



**9 



Grade 11 



22 
_1_ 



41 



Grade 12 



23 



30 



31 



Figure 8. Measurement 
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Geometry 

Fewer grade levels are depicted for 
geometry scores, largely because most 
tests contain few geometry objectives and 
some tests contain none (see Figure 8). 
The range of content being tested may 
account for the variability in scores, 
especially in grade 5, or the scores may 
reflect a lack of emphasis in the instruc- 
tional program. At any rate, the scores 
approach acceptability in grade 5, but in 
both grade 8 and grade 1 1 many items are 
being answered correctly by only 40% to 
50% of the students. 



Grade 5 



Grade 8 



Grade 1 1 



15 



20 
_] 



30 



33 42 



71 



28 34 41 

-J I 



72 



Figure 9. Geometry 



Problem Solving 

The great variability of the content in- 
cluded in problems, and the resulting 
variability in difficulty level, makes graphic 
display of the data virtually meaningless. 
Figure 10 presents the scores for each 
grade level. No clear patterns emerge, 
except for the broad range of scores at 
most grade levels, and the varying points 
at which most scores cluster. 

Scores on problems with each opera- 
tion with each topic are generally lower 
than scores on the topics alone, when 
items are parallel. Since the tests were not 
usually developed to check this conclu- 
sion, parallel items seldom occur. The 
National Assessments do provide support 
for this idea, however, when parallel items 
were specifically developed, in addition, 
some support is generated by the data 
from standardized tests, on which pro- 
blem-solving scores generally lie below 
computation scores. 

On most problems focusing on prob- 
lem-solving strategies (such asguessand 
test, look for a pattern, or find relevant 
data), scores tended to cluster arou nd the 
60 percent level, with a range of 22 to 96. 
Scoresonconsumerorcareerappiication 
items ranged from 14 to 97, with a large 
cluster in the 80s. 



Grade 3 



56 



Grade 4 t . 



22 



Grade 5 



Grade 6 



Grade 7 



17 



51 



70 



14 

_ 1_ 



27 

1 



39 



Grade 



8 h 



29 
_1_ 



-H- 



Grade 9 



20 



Grade 10 



54 

-H- 



Grade 1 1 



20 



Grade 12 



33 



Figure 10. Problem Solving 



General Conclusion on Achievement 



It should be apparent from the data 
displayed that children are scoring well on 
items dealing with computation, especial- 
ly with whole numbers. However, scores 
on items dealing with concepts and prob- 
lem solving are not as high. The state- 
ments from state report after state report 
are very clear on this; for instance, here is 
an excerpt from the California report: 
schools are doing a good job of 
teaching tasks requiring computation 
and recognition. However, increases 
were relatively small on problem solv- 
ing and application questions, which 
require students to think. This weaker 
growth pattern led the committee to 
believe that such skills are not being 
reinforced in classrooms. Simply 
teaching students low-level knowl- 
edge and skills is unlikely to improve 
substantially higher-Sevel cognitive 
skills and understanding. Improve- 
ments in higher cognitive skills will 
occur only when higher-level problem 
solving becomes a curricular and in- 
structional focus. (California, 1984, p. 
51). 



The National Assessment of Educa- 
tional Progress, dealing with a nationwide 
sample of students, provides data on their 
achievement on common sets of items. 
The same concern expressed by many of 
the states individually is reflected in the 
report on the third national assessment in 
mathematics (as it also hasbeen in reports 
of the first two assessments): 

it appears that American schools 
have been reasonably successful in 
teaching students to perform routine 
computational and measurement skills, 
and to answer questions assessing 
superficial knowledge about numbers 
and geometry. It is encouraging to note 
positive change on items assessing 
knowledge and skills not only in 
numerical computation, but also in 
geometry and measurement. On the 
other hand, it appears from the low 
percentagesof successon some items 
that schools have thus far taught only a 
small percentage of students how to 
analyze mathematical problems or 
apply mathematics to nonroutine situa- 
tions. (NAEP, 1983, pp. 2-3) 
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